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Abstract: This paper considers the distributed consensus problem of multi-agent systems with general 
continuous-time linear dynamics. Two distributed adaptive dynamic consensus protocols are proposed, 
based on the relative output information of neighboring agents. One protocol assigns an adaptive coupling 
weight to each edge in the communication graph while the other uses an adaptive coupling weight for each 
node. These two adaptive protocols are designed to ensure that consensus is reached in a fully distributed 
fashion for any undirected connected communication graphs without using any global information. A 
sufficient condition for the existence of these adaptive protocols is that each agent is stabilizablc and 
detectable. The- cases with leader-follower and switching communication graphs are also studied. 

' Keywords: Multi-agent system, consensus, cooperative control, adaptive control, relative output. 

</3 ! 

lHj| 1 Introduction 

<N ■ 

j> ■ Consensus is an important problem in the area of cooperative control of multi-agent systems. 

• The main idea of consensus is to develop distributed control policies that enable a group of agents 

to reach an agreement on certain quantities of interest. Due to its potential applications in broad 

| areas such as spacecraft formation flying and sensor networks, the consensus problem has been 

extensively studied by numerous researchers from various perspectives; see [U [21 [3l HI O [61 [7] 
t-h . and references therein. Specifically, a general framework of the consensus problem for networks 

of integrators with fixed or switching topologies is proposed in [2]. The controllability of leader- 
follower multi-agent systems is considered in [8] from a graph-theoretic perspective. Distributed 
tracking control for multi-agent consensus with an active leader is addressed in (9J [10] by using 
neighbor-based state estimators. Consensus of networks of double- and high-order integrators 
is studied in [61 [TLj [L2] . Consensus algorithms are designed in [13] for a group of agents with 
quantized communication links and limited data rate. In most existing studies on consensus, 
the agent dynamics are assumed to be first-, second-, or high-order integrators, which might be 
restrictive in many cases. 

This paper considers the distributed consensus problem of multi-agent systems with general 
continuous-time linear dynamics. Previous works along this line include |14| [T5| [TBI \T7\ [T8| \19\ 
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[20] . One common feature in |14[ [T5"| \TT\ \19\ [20] is that at least the smallest nonzero eigenvalue 
of the Laplacian matrix associated with the communication graph is required to be known 
for the consensus protocol design. However, the smallest nonzero eigenvalue of the Laplacian 
matrix is global information in the sense that each agent has to know the entire communication 
graph to compute it. Therefore, the consensus protocols given in [TJl [151 E3 CE1 HO] cannot be 
implemented by the agents in a fully distributed fashion, i.e., using only the local information 
of its own and neighbors. To overcome this limitation, an adaptive static consensus protocol is 
proposed in [21], which is motivated by the adaptive strategies for synchronization of complex 
networks in [22] . Similar adaptive schemes are presented to achieve second-order consensus with 
inherent nonlinear dynamics in [23] . Note that the protocols in |21[ [22j [23] rely on the relative 
states of neighboring agents, which however might not be available in many circumstances. 

In this paper, we extend [2TJ[23] to investigate the case where the relative outputs, rather than 
the relative states, of neighboring agents are accessible. Two novel distributed adaptive dynamic 
consensus protocols are proposed, namely, one protocol assigns an adaptive coupling weight to 
each edge in the communication graph while the other uses an adaptive coupling weight for 
each node. These two adaptive protocols are designed to ensure that consensus is reached in a 
fully distributed fashion for any undirected connected communication graph without using any 
global information. A sufficient condition for the existence of these adaptive protocols is that 
each agent is stabilizable and detectable. The cases with leader-follower and switching graphs 
are also studied. It is shown that the consensus protocol with an adaptive coupling weight for 
each edge is applicable to arbitrary switching connected communication graphs. It is worth 
mentioning that the consensus protocols in |16[ [T8] do not need any global information either. 
However, in [16] the protocol is based on the relative states of neighboring agents and the agent 
dynamics are restricted to be neutrally stable. In [18], the eigenvalues of the state matrix of 
each agent are assumed to lie in the closed left-half plane. Furthermore, the dimension of the 
protocol in [18] is higher than that of the consensus protocol with an adaptive coupling weight 
for each node in the current paper. 

The rest of this paper is organized as follows. Some useful results of the graph theory are 
reviewed in Section 2. The consensus problems under the proposed two distributed adaptive 
protocols are investigated in Section 3. The consensus problem with leader- follower and switch- 
ing communication graphs are studied, respectively, in Sections 4 and 5. A simulation example 
is presented in Section 6 to illustrate the analytical results. Section 7 concludes the paper. 

2 Notation and Graph Theory 

Let R nxn be the set ofnxn real matrices. The superscript T means the transpose for real 
matrices, ijy represents the identity matrix of dimension N. Matrices, if not explicitly stated, 
are assumed to have compatible dimensions. Denote by 1 the column vector with all entries 
equal to one. The matrix inequality A > B (respectively, A > B) means that A — B is positive 
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definite (respectively, positive semi-definite). A ® B denotes the Kronecker product of matrices 
A and B. diag(^4i, • • • , An) represents a block-diagonal matrix with matrices Ai, % = 1, • • • ,N, 
on its diagonal. A matrix is Hurwitz if all of its eigenvalues have negative real parts. 

A directed graph Q is a pair (V, £), where V = {v±, • • • , vjy} is a nonempty finite set of nodes 
and £ C V x V is a set of edges, in which an edge is represented by an ordered pair of distinct 
nodes. For an edge (vi,Vj), node vi is called the parent node, node Vj the child node, and Vi 
is a neighbor of Vj. A graph with the property that (vi,Vj) 6 £ implies (vj,Vi) € £ for any 
Ui, Uj € V is said to be undirected. A path from node to node is a sequence of ordered 
edges of the form (vi k ,Vi k+1 ), k = 1, • • ■ ,/ — 1. An undirected graph is connected if there exists a 
path between every pair of distinct nodes, otherwise is disconnected. A directed graph contains 
a directed spanning tree if there exists a node called the root, which has no parent node, such 
that the node has directed paths to all other nodes in the graph. 

The adjacency matrix A = [a^] € p/^xiv ass0 ciated with the directed graph Q is defined by 
an = 0, dij = 1 if 6 £ and a^- = otherwise. The Laplacian matrix £ = [Cij] £ r/^x7V 
is defined as Cu = Ylj^i a ij an< ^ = ~ a iji * 3- F° r undirected graphs, both A and C are 
symmetric. 

Lemma 1 [M I2| 15]. 

(1) Zero is an eigenvalue of C with 1 as a corresponding right eigenvector, and all nonzero 
eigenvalues have positive real parts. Furthermore, zero is a simple eigenvalue of C if and only if 
the graph Q has a directed spanning tree. 

(2) For an undirected graph Q, the smallest nonzero eigenvalue A2(£) of the Laplacian matrix 
C satisfies A 2 (£) = min ^f^. 

V ; ^0,l T z=0 x x 

3 Consensus with Undirected Communication Graphs 

In this section, we assume that the communication graph among the agents, denoted by Q, is 
undirected. Consider a group of N identical agents with general linear dynamics. The dynamics 
of the z-th agent are described by 

(1) 

Vi = Cx h i = 1,-- - , N, 

where Xi € R n is the state, Uj € R p the control input, ?/j G R 9 the measured output, and A, B, 
C are constant matrices with compatible dimensions. 

In order to achieve consensus for the agents in (pQ), a variety of static and dynamic consensus 
protocols have been proposed in, e.g., [HI [TSJ [El H3 [TSJ [THJ, [2D]. One common feature in 
[144 [T5| [T71 [T9| [20] is that at least the smallest nonzero eigenvalue A2 of the Laplacian matrix 
associated with Q is required to be known for the consensus protocol design. However, A2 is 
global information in the sense that each agent has to know the entire graph Q to compute 
it. Therefore, the consensus protocols given in |14[ fT5[ Wl\ [T9] [20] cannot be implemented by 
the agents in a fully distributed fashion, i.e., using only the local information of its own and 
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neighbors. To overcome this limitation, an adaptive static consensus protocol is proposed in 
|21| . which is motivated by the adaptive strategies for synchronization of complex networks in 
[22j . Note that the protocols in [211 [22] are based on the relative states of neighboring agents, 
which however might not be available in many circumstances. 

In this paper, we extend to investigate the case where each agent knows the relative outputs, 
rather than the relative states, of its neighbors with respect to itself. Two novel distributed 
adaptive dynamic consensus protocols are proposed. The first adaptive consensus protocol 
dynamically updates the coupling weight for each edge (i.e., the communication links between 
neighboring agents), which is given by 
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(A + BF)vi + iV CjtHj [C(vi - vj) - (yi - yj)] 
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where V{ G R n is the protocol state, i = 1, ••■ ,N, aj,- is the (i,j)-ih entry of the adjacency 
matrix A associated with Q, Cij(t) denotes the time- varying coupling weight for the edge 
with Cij(O) = Cjj(O), Kij = Kji are positive constants, and L G H gxn , F G R pxn , and V G B? qx2q 
are gain matrices to be determined. 

The second adaptive consensus protocol assigns an adaptive coupling weight to each node 
(i.e., agent), described by 

N 

ii = (A + BF)vi + diL ^ ay [Cfa 

5=1 

T\ 

/ Vi — Vi 

di = n 



(Vi -vj)} 




Vi - Vj 
C(vi - Vj) 
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J =1 



Vi - Vj 
C(vi - Vj) 



(3) 
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Fvi 



,N, 



where Vi G R n is the protocol state, i = 1, 2, • • • ,N, di{t) denotes the coupling weight for agent 
i, Ti are positive constants, and the rest of the variables are defined as in ([2D- 

The objective in this section is to find proper gain matrices in ([2]) and ([3]) such that the N 



agents in ([T]) achieve consensus in the sense of lim 



\ Xi (t) - X j(t)\\ =0, Vt,j = !,••• ,N. 



3.1 Consensus Under Adaptive Protocol ((2]) 

In this section, we study the consensus problem of the agents in ([!]) under the adaptive protocol 



Let Zi = [xf, vf] T , a = Zi- i ^2 j=1 Zj, z = [z[, • • • , z%] T , and e 



,e N ] ■ Then, 



we get e = [(/ 



N 



N 



11 T ) I 2n ]z. It is easy to see that is a simple eigenvalue of I 



N 



ll 1 



with 1 as a corresponding eigenvector, and 1 is the other eigenvalue with multiplicity N — 1. 
Then, it follows that e = if and only if z\ = ■ ■ ■ = zn- Therefore, the consensus problem of 
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agents (JTJ) under the protocol ([2]) is solved if e converges to zero. It is not difficult to obtain 
that a and Cij satisfy 



A 1 



ei = Mei + CijaijV.(ei - e 
j'=i 



(4) 



where 
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A + BF 
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LC 



7e = (/ 2 ®c T )r(/ 2 ®c). 

The following theorem presents a sufficient condition for solving the consensus problem. 
Theorem 1. Assume that the communication graph Q is undirected and connected. Then, 
the N agents in flTJ) reach consensus under the adaptive protocol ([2]) with F satisfying that 



A + BF is Hurwitz, Y 



, and L = -Q~ l C T , where Q > is a solution to the 



following linear matrix inequality (LMI): 

A T Q + QA- 2C T C < 0. 



(5) 



Moreover, the protocol states Vi, i = 1, • • • ,N, converge to zero and each coupling weight Cj,- 
converges to some finite steady-state value. 

Proof. Consider the Lyapunov function candidate 

N N N (r- n) 2 



i=l 



i=l j=l,j^i 



where Q 



, P > satisfies P(A + BF) + (A + BF) T P < 0, and a and ? are 



qP + Q -Q 
-Q Q 

positive constants to be determined later. It is easy to verify that Q > 0. 
The time derivative of V\(t) along the trajectory of can be obtained as 



N N 



i j 



i=l i=l j=l t jj^i l 3 

N N 

2 Yl e fQi Me i + Yl r ij":i n, < ( ■ ~ e i)\ 
3=1 



(7) 



i=i 

N N 



+ Y X] ~ Q ) a *i( e * ~~ ej) T 7l(ei - ej). 

i=l j=l,jjLi 
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Let e-i = Tei, i = 1, • • ■ ,N, with T 



Iq 



. Then, ([7]) can be rewritten as 



N N N 

Vi = 2 ejQ[Mei + 'W " %)] 

i=l i=l j'=l 

AT AT 

+ ^ ^ (cjj - a)aij{ei - e,) T ft(ej - £,), 

i=l j=l } jjLi 



where 



g 4 T~ r gT _1 



By noting that L = —Q 1 C T , we can see that 



?P 
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LC 



M = TMT- 1 



K = T~ T 1ZT~ l 



A + BF BF 
A 



C T C 



gft = ft. 



(9) 



Because k;^ = Cjj(O) = Cjj(O), and T is symmetric, it follows from ([2]) that Cy(i) = Cji(t), 
Vt > 0. Therefore, we have 



(10) 



(11) 



AT AT 

X] X - ot)aij{ei - ej) T Tl(ei - ej) 

N N 

= 2 yj y^(cjj - a)aijejll{ei - ej). 
i=l j=i 

Let e = [ef , • • • , e^] T . Using (JTO]) and ©, it follows from © that 

AT JV JV 

Vi = ejQMh - 2 J^J^ aa^ef ft(e, - g,-) 

i=l i=l j=l 

= e T [/Ar ® (Q.M + .M T g) - 2a£ <g> ft]e, 

where £ is the Laplacian matrix associated with Q. 

By the definitions of e and e, it is easy to see that (1 T <8> /)e = (1 T ® T)e = 0. Because £/ is 
connected, it then follows from Lemma 1 that 

e T (C® I)e > A 2 (£)e T e, (12) 

where A 2 (£) is the smallest nonzero eigenvalue of C. Therefore, we can get from (jlip that 

Vi < e T [I N ® (Q7W + 7W T Q - 2aA 2 (£)ft)]e. (13) 

Note that 

Q7W + 7W T Q-2aA 2 (/:)ft 

V(P(^4 + BF) + (A + BF) T P) sPBF ( u ) 



sF T B T P 



QA + A T Q-2a\ 2 {C)C T C 
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By choosing a sufficiently large such that a\2{C) > 1, it follows from ([5]) that QA + A T Q — 
2a\2(C)C T C < 0. Then, choosing ? > sufficiently small, and in virtue of Schur Complement 
Lemma 1251. we can obtain from (1141) that 



QM + M T Q - 2a\ 2 {C)n < 0. 

Therefore, Vi < 0. 

Since V\ < 0, V±(t) is bounded, implying that each Cjj is also bounded. By noting that 7Z is 
positive semi-definite, we can see from that Cjj is monotonically increasing. Then, it follows 
that each coupling weight c%j converges to some finite value. Note that V\ = implies that e = 
and e = 0. Hence, by LaSalle's Invariance principle [26], it follows that e(t) — > 0, as t — > oo. 
That is, the consensus problem is solved. By (|2j) and noting the fact that A + BF is Hurwitz, 
it is easy to see that the protocol states Vi, i = 1, ■ ■ ■ ,N, converge to zero. ■ 

Remark 1 . As shown in [14] , a necessary and sufficient condition for the existence of a Q > 
to the LMI ([5]) is that (A, C) is detectable. Therefore, a sufficient condition for the existence of 
a protocol ([2]) satisfying Theorem 1 is that (A,B,C) is stabilizable and detectable. It is worth 
noting that a favorable feature of ([2]) is that its gain matrices F, L and F can be independently 
designed. 

3.2 Consensus Under Adaptive Protocol ([3]) 

This section considers the consensus problem of the agents in (pQ) under the adaptive protocol 
([3]). Let Zi = [xJ,vf] T , d = Zi - jfJ2f=\Zji an d C = [Ci\ ' ' ' XnV- As shown in the last 
subsection, the consensus problem of agents (Q} under the protocol © is solved if £ converges 
to zero. We can obtain that Q and di satisfy the following dynamics: 

N . N N 

N N K ' 

di = Ti{^2 a ij(d - (j) T ]K(}2 a v(Ci ~Cj)}, « = !,•••, N, 

3=1 3=1 

where M, H, 1Z are defined in (jj]). Let D(t) = diag(c?i(t), • • • , d/^(t)). Then, the first equation 
in (|15j) can be rewritten into a compact form as 

( = [I n ®M + ((I N --^11 t )DjC)®H](, (16) 

where C is the Laplacian matrix associated with Q. 

Theorem 2. Assume that the communication graph Q is undirected and connected. Then, 
the N agents in (JTJ) reach consensus under the protocol ([3|) with F, L, and T given as in Theorem 
1. Moreover, the protocol states 5j, i = 1, • • ■ , N, converge to zero and each coupling weight di 
converges to some finite steady-state value. 

Proof. Consider the Lyapunov function candidate 

i=l 
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where Q is defined in ([6|), and j3 is a positive constant to be determined later. For a connected 
graph Q, it follows from Lemma 1 and the definition of ( that C T (£<8 Q)C ^ ^2{C)C, T (In ® Q)C- 
Therefore, it is easy to see that Vl c = {£, di\V 2 < c } is compact for any positive c. 

Following similar steps to those in the proof of Theorem 1, we can obtain the time derivative 
of V 2 along the trajectory of (fT6|) as 

N 



V 2 = 2C T {C®Q)C + Y.—d l 



8=1 



N 



di-p 



2( T [C ®QM + (CDC - CU T DC) ® QV]C + E ~ 



i=l 



A? 



(18) 



where C = [Ci , " " " » CnY = (In <8> T)( with T 
(El). Observe that 



Iq 



and Q, A4, 1Z are the same as in 



N N N 

( T [(CDC)®K}( = J>2>j(Ci " Cif^E^O " Ci)]- 

i=l i=l j=l 



(19) 



Moreover, the second equation in (|15p can be rewritten as 

JV N 



di = Ti^OijiCi - C7) T ]^E°ti(Ci - Ci)]- 

3=1 3=1 



(20) 



Substituting (JTSD and (gUJ) into (JTHD yields 



AT AT Af 

V 2 = 2( T (C ® GM)C - 20 £E %(0 - 0) T ]^E «tf(C< - Ci)] 

i=i i=i i=i 

= C T [£ ® (GM + -M T Q T ) - 2/3£ 2 ® ft]C. 



(21] 



Because is connected, it follows from Lemma 1 that zero is a simple eigenvalue of C and 



all the other eigenvalues are positive. Let U = [ 1 Yi ] and U 7 



N 

L Y 2 



with Y 1 G R^x(JV-l) j 



Y2 € R( Ar - 1 ) xJV ) be such unitary matrices that U T CU = A = diag(0, A2, • • • , Aat), where A2 < 
• • • < Ajv are the nonzero eigenvalues of C. Let £ = [(f, • • • , C^>] T = (U By the definitions 

of £ and £, h is easy to see that £1 = (1 



T)C = 0. Then, it follows from (HQ that 



y 2 = C J [A (OM + M J Q J ) - 2(3A Z ® ft]C 

A" 

= E A *Cf + M T Q T - 2pXiR)Ci. 



(22) 



i=2 



As shown in the proof of Theorem 1, by choosing f3 sufficiently large such that (3A 2 (C) > 1 
and ? > sufficiently small, we can obtain from (I22p that V2 < 0. Note that V 2 = that Ci = 0, 
i = 2, • • • , JV, which, together with £1 = 0, further implies that £ = 0. Therefore, it follows from 
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Lasalle's Invariance principle that £ — > 0, as t — > oo. The convergence of and i = 1, • • • , iV, 
can be shown by following similar steps in the proof of Theorem 1, which is omitted here for 
brevity. ■ 

Remark 2. Different from the previous adaptive schemes in |21 [ \22 \ [25]. which are based on 
the relative state information, the proposed adaptive protocols ([2]) and (|3j) rely on the relative 
outputs of neighboring agents. Contrary to the protocols in [H] [151 C3 EH 120]) the adaptive 
protocols ([2]) and ([3]) can be computed and implemented by each agent in a fully distributed 
fashion without using any global information. It is worth mentioning that the consensus pro- 
tocols in |16[ [T5] do not need any global information either. However, in |16] the protocol is 
based on the relative states of neighboring agents and the agent dynamics are restricted to be 
neutrally stable. In [18] . the eigenvalues of the state matrix of each agent are assumed to lie in 
the closed left-half plane. Furthermore, the dimension of the protocol in [18] is higher than that 
of the adaptive protocol (|3|). 

Remark 3. Some comparisons between the adaptive consensus protocols ^ and are now 
briefly discussed. The dimension of the adaptive protocol ([2]) is proportional to the number of 
edges in the communication graph. Since the number of edges is usually larger than the number 
of nodes in a connected graph, the dimension of the protocol ([2]) are generally higher than that 
of ([3]). On the other hand, the adaptive protocol ([2]) are applicable to the case with switching 
communication graphs, which will be shown in Section 5. 



4 Consensus with Leader-Follower Communication Graphs 

The section extends to consider the case where the N agents in ([Tj) maintain a leader-follower 
communication graph Q. Without loss of generality, assume that the agent indexed by 1 is the 
leader whose control input u\ = and the agents indexed by 2, • • • ,N, are followers. The leader 
does not receive any information from the followers, i.e., it has no neighbor, while each follower 
can obtain the relative outputs with respect to its neighbors. 
In the sequel, the following assumption is needed. 

Assumption 1. The subgraph associated with the followers is undirected and the graph Q 
contains a directed spanning tree with the leader as the root. 

Denote by C the Laplacian matrix associated with Q. Because the leader has no neighbors, 
£, can be partitioned as 

Oix(iV-i) 

where C 2 € R^" 1 )* 1 and C x € ^-l)x{N-l) is symmetric. 

It is said that the leader-follower consensus problem is solved if the states of the followers 
converge to the state of the leader, i.e., lim^oo \\xi(t) — xi(t)\\ = 0, M i = 2, • • • , N. 

Based on the relative output information of neighboring agents, the first adaptive consensus 



C 



(23) 
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protocol with a dynamic coupling weight for each edge is proposed for the followers as follows: 

TV 

ti = (A + BF)vi + L E 11 ■,")] ~ Vj) - {Vi - Vj)) , 
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Vi - Vj 
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Vi - Vj 


C(vi - Vj)_ 




_C(vi - vj)_ 



(24) 



Ui = Fvi, i = 2, • • • ,N, 

where Uj G R" is the protocol state, i = 2, • • • , N, v\ £ R n is generated by v\ = {A + BF)v\, 
is the (i,j)-th entry of the adjacency matrix A of Q, dij is the coupling weight associated with 
the edge (j, i) with dij(0) = dji(0) for i, j = 2, ■ ■ ■ , N, e^- = eji are positive constants, L G R <?xn , 
F G R pxn , and T G R 2( ? x2( ?. 

Theorem 3. For any graph Q satisfying Assumption 1, the N agents in (JTJ) reach leader- 
follower consensus under the protocol (|24p with F, L, and V given as in Theorem 1. Meanwhile, 
the protocol states Vi, i = 2, • • • , N, converge to zero and the coupling weights dij converge to 
finite steady-state values. 



Proof. Let & 



Vi - Vl 



2, ■ • • , N . Then, we can get from (HD and §M§ that 



L = + E dijCLijUiZi - £j) + duanU^i 



(25) 



= eijdijiii - ij) T U{ii - £,•)> i = 2, - - • , A, 

where A^, % and 1Z are the same as in @. Clearly, the leader- follower consensus problem of 

([1]) is solved by (f24"|) if the states £j of ([25]) converge to zero. 

Consider the Lyapunov function candidate 

TV N N Yi 

(dij - 7) 



y 3 = E^+E E 



2e, ; 



+ E 



(26) 

i=2 i=2 j=2,j^i " J i=2 ll 

where 7 is a positive constant and Q is defined in ([U]). Following similar steps to those in the 
proof of Theorem 1, the time derivative of V2 along the trajectory of (|25|) can be obtained as 

N N N a a N ofA \ 



i=2 

TV 



i=2 



C-ii 



i=2 j=2,j^i -■> 
N 

2 E + E d iJ a iM£i ~ ii) + daaiMi] 

i=2 



(27) 



i=2 



TV TV TV 

E E - & - &) T £(6 - 6) + 2 E^ 1 - 

i=2 i=2jVi 



i=2 



where £j = T£j with T 



/, 



and Q, M,n,TZ are defined in (jSb. 
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Since the subgraph associated with the N — 1 followers is undirected, we have 

TV TV 

E E (*i-7)Mli-&f£(ei-&) 

i=2 j=2,&i 

TV TV 

= 2 E E^ - TK-^fo - &•)■ 

i=2 j=2 



Letting £=[£%, 



,Cn] , it then follows from (J2ZJ) that 

TV AT TV 



TV 



^3 = 2 E ^0^6 - 27 E E %^(& - 4) - 27 E 

i=2 i=2 j=2 

= ^[/jv.i <8) + A4 T Q) — 2 7 A <g> K]£, 



i=2 



(28) 



where C\ is defined in (|23j) . 

For any graph £/ satisfying Assumption 1, it follows from Lemma 1 and f|23j) that £i is positive 
definite. Thus, 



where A 2 (£) is the smallest eigenvalue of L\. Then, we have 

V 3 < | T [^tv-i ® (QA4 + A^ T Q - 2 7 A 2 (£)^)]e 



(29) 



The rest of the proof is similar to that of Theorem 1, which is omitted for brevity. ■ 
Corresponding to ([3]), the second adaptive consensus protocol with a time- varying coupling 
weight for each follower is proposed as 

TV 

Vi = {A + BF)vi + diL ^2 a ij [C(vi - %) - (yi ~ Vj)} , 



TV 



<k = €j [ e 1 



j'=i 

Vi ~ Vj 
C(vi - vj) 



TV 



ME- 

vi =1 



^ - 



(30) 



Ui = Fdi, i = 2, ■•• ,iV, 



where t), G R n is the protocol state, i = 2, • • • , N, v± € R n is generated by vi = (A + BF)v±, d{ 
denotes the coupling weight associated with follower i, and e, are positive constants. 

Theorem 4. For any graph Q satisfying Assumption 1, the ./V agents in ([1]) reach leader- 
follower consensus under the protocol (|3Up with with F, L, and T given as in Theorem 1. 
Meanwhile, the protocol states Vi, i = 2, • • • , N, converge to zero and each coupling weight di 
converges to some finite steady-state value. 

Proof. Let Qi = % , i = 2, • • • , N. Clearly, the leader-follower consensus problem of 

Vi - Vi\ 

([TJ under ()30|) is solved if Qi, i = 2, • • • , N, converge to zero. It is easy to see that Qi and d{ 
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satisfy 



N 



Qi = M.Qi + diU^^di^Qi - Qj) + anQi], 
3=2 

N N 

di = ei(y]<Hj(Qi ~ Qj) + a i iQ i ) T TV^^a i j(Qi - Qj) + aaQi], i = 2, • • • ,N. 

3=2 j=2 

Consider the Lyapunov function candidate 

N N ,i s 2 



(31) 



(32) 



i=2 i=2 

where a is a positive constant and Q is defined in ([6]). The rest of the proof can be completed 
by following similar steps in proving Theorems 2 and 3. ■ 

5 Extensions to Switching Communication Graphs 

In the last sections, the communication graph is assumed to be fixed throughout the whole 
process. However, the communication graph may change with time in many practical situations 
due to various reasons, such as communication constraints, link variations, etc. In this section, 
the consensus problem under the adaptive protocol ([2]) with switching communication graphs 
will be considered. 

Denote by £f/v the set of all possible undirected connected graphs with N nodes. Let a(t) : 
[0, oo) — > 3? be a piecewise constant switching signal with switching times to, t\, ■ ■ ■ , and & be 
the index set associated with the elements of SfjVi which is clearly finite. The communication 
graph at time t is denoted by Q a (t) ■ Accordingly, ([2]) becomes 

N 

Vi = (A + BF)vi + L^CijOjj(f) [C(vi - vj) - - , 



C{j — K{jdij(t^ 





T 




Vi - Vj 


r 


Vi - Vj 


_C(vi - Vj)_ 




_C(vi - Vj)_ 



(33) 



u. 



,N, 



where ay(t) is the (i, j)-th entry of the adjacency matrix associated with Ga(t) an d the rest of 
the variables are the same as in ([2]). 

Theorem 5. For arbitrary switching communication graphs G a (t) belonging to Sfjv, the 
agents in (TTJ reach consensus under the protocol f|33|) with F, L and T given as in Theorem 
1. Besides, the protocol states Vi, i = 1, ■ ■ ■ , N, converge to zero and the coupling weights 
converge to some finite values. 



Proof. Let e, 



ik Ej=i Xj, i = !,■•■ ,N, and e = [e 



T 
1 i 



By following similar 



steps to those in the proof of Theorem 1, the consensus problem of the agents ([!]) under the 
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(34) 



protocol ([33]) is solved if e converges to zero. Clearly ej and Cjj satisfy 

N 

ti = Mei + y^(cjj + S)a i j(t} / H(e i - ej), 

3=1 

dij = Kij<iij(t)(ei — ej) T^-ifii — ej), z = 1, • • • , iV, 

where Cjj = Cjj + 5, <5 is a positive scalar, and A4, H and 1Z are denned as in @. 
Take a common Lyapunov function candidate as 

N N N ~2 

nK*)=£* T e*+£ E 2^ (35) 

i=l i=l j=l,j^j ^ 



where Q is defined in (|p|). The time derivative of V5 along the trajectory of (|34|) can be obtained 

as 

F 5 = 2£ef<2e J + £ £ ^j 



N N N 

,3¥=* 

N N 



i=l i=l j=lj^ii l 3 



= 2^ejQ[Me t + £(qj + 5)a tj {t)U{e t - ej)] 

i=i 3=1 (36) 

N N 

+ ^ ^ Cijaij(t)(ei- ej) T TZ(ei- ej) 

i=l j=l,jj^i 

= e T [I N ® (QM + M T Q) - 25£ a{t) ®K}e, 
where (jlOp has been used to obtain the last equality, £ a (t) is the Laplacian matrix associated 
with G a (t), and the rest of the variables are the same as in ([8]). 

HI) 



Since Q a (t) is connected and (1 T <g> I)e = 0, it is easy to see that 



e T (C a{t) 0l)e>Xf n e T e, (37) 

where A™ 111 = ming {A2 (^ CT (t) )} denotes the minimum of the smallest nonzero eigenvalues 

of C a (±) for all G a (t) ^ ^/v- Therefore, we can get from ([36]) that 

V s < e T [I N ® (OM + A4 T Q - 25A!T 1 ft)]e 

(38) 

= W(e). 

As shown in the proof of Theorem 1, by choosing 5 sufficiently large such that <5A™ m > 1 and 
7 > sufficiently small, we have QM + M T Q - 25X2 in TZ < 0. Therefore, V 5 < 0, implying 
that V5 is bounded. Consequently, c^-, i,j = 1, ■ ■ ■ , iV, are bounded. By noting ([34"|) . each Cjj 
is monotonically increasing. It then follows that each converges to some finite value. Thus, 
the coupling weights Cjj converge to finite steady-state values. Note that V5 is positive definite 
and radically unbounded. By LaSalle-Yoshizawa theorem [26], it follows that lim^oo W(e) = 0, 
implying that e(t) — >• 0, as t — >• 00, which further implies that e(t) — > 0, as f — > 00. This 
completes the proof. ■ 

Remark 4. Theorem 5 shows that the adaptive consensus protocol ([2]) given by Theorem 1 is 
applicable to arbitrary switching communication graphs which are connected at any time instant. 
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The case with switching leader-follower graphs can be discussed similarly, thus is omitted here for 
brevity. Because the Lyapunov function in (|1T[) for the adaptive protocol (|3j) is explicitly related 
with the communication graph, it cannot be taken as a feasible common Lyapunov function. 

6 Simulation Examples 

In this section, a simulation example is provided to validate the effectiveness of the theoretical 
results. 




(a) Qx (b) g 2 

Figure 1: Undirected communication graphs Q\ and Qi- 

Consider a network of third-order integrators, described by ([!]) with 
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A = 


1 


, B = 





, c = 


1 









1 







Choose F = — [3 6.5 4.5] such that A + BF is Hurwitz. Solving the LMI (jSJ by using the LMI 
toolbox of Matlab gives the gain matrix L in ([33]) and as L = — [2.5039 1.9056 0.9194 ] T . To 
illustrate Theorem 5, let G a (t) switch randomly every 0.1 second between Q\ and Q2 as shown 
in Figure 1. Note that both Q\ and Q2 are connected. Let Kij = 1, i,j = 1, • • • , 6, in (|33|) . and 
Cjj(0) = Cji(0) be randomly chosen. The consensus errors Xi — x\, % = 2, • • • , 5, of the third-order 
integrators under the protocol ([2]) with F, L as above and V = ~jl are depicted in Figure 
2. The coupling weights Cy associated with the edges in this case are shown in Figure 3. To 
illustrate Theorem 2, let the communication graph be Q\ in Figure 1(a) and T{ = 1, i = 1, • • • ,6, 
in ([3]). The consensus errors Xj — x±, i = 2, • • • ,5, of the third-order integrators under the 
protocol ([3]) with F, L, and T as above are depicted in Figure 4. The coupling weights d{ 
associated with the nodes are drawn in Figure 5. Figures 2 and 4 state that consensus is indeed 
achieved in both cases. From Figures 3 and 5, it can be observed that the coupling weights 
converge to finite steady-state values. 
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10 15 20 25 30 

time (s) 



Figure 2: The consensus errors X{ — x\ of third-order integrators under (I33j) 




Figure 3: The coupling weights Cjj associated with the edges in ([331 . 




5 10 15 20 25 30 



Figure 4: The consensus errors Xi — x\ of third-order integrators under Q. 



3 








-0.5 1 1 1 1 1 1 1 

5 10 15 20 25 30 

time ( s) 



Figure 5: The coupling weights di associated with the nodes in ©. 



15 



7 Conclusion 



In this paper, the consensus problem of multi- agent systems with identical general linear dy- 
namics has been considered. Based on the relative output information of neighboring agents, 
two distributed adaptive dynamic consensus protocols have been proposed, namely, one pro- 
tocol assigns an adaptive coupling weight to each edge in the communication graph while the 
other uses an adaptive coupling weight for each node. These two adaptive protocols have been 
designed to ensure that consensus is reached in a fully distributed fashion for any undirected 
connected communication graphs without using any global information. 
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